Future state maximisation as an intrinsic motivation for decision making

The concept of an “intrinsic motivation" is used in the psychology literature to distinguish between behaviour which is motivated by the expectation of an immediate, quantifiable reward (“extrinsic motivation") and behaviour which arises because it is inherently useful, interesting or enjoyable. Examples of the latter can include curiosity driven behaviour such as exploration and the accumulation of knowledge, as well as developing skills that might not be immediately useful but that have the potential to be re-used in a variety of different future situations. In this thesis, we examine a candidate for an intrinsic motivation with wide-ranging applicability which we refer to as “future state maximisation". Loosely speaking this is the idea that, taking everything else to be equal, decisions should be made so as to maximally keep one's options open, or to give the maximal amount of control over what one can potentially do in the future. Our goal is to study how this principle can be applied in a quantitative manner, as well as identifying examples of systems where doing so could be useful in either explaining or generating behaviour. We consider a number of examples, however our primary application is to a model of collective motion in which we consider a group of agents equipped with simple visual sensors, moving around in two dimensions. In this model, agents aim to make decisions about how to move so as to maximise the amount of control they have over the potential visual states that they can access in the future. We find that with each agent following this simple, low-level motivational principle a swarm spontaneously emerges in which the agents exhibit rich collective behaviour, remaining cohesive and highly-aligned. Remarkably, the emergent swarm also shares a number of features which are observed in real flocks of starlings, including scale free correlations and marginal opacity. We go on to explore how the model can be developed to allow us to manipulate and control the swarm, as well as looking at heuristics which are able to mimic future state maximisation whilst requiring significantly less computation, and so which could plausibly operate under animal cognition

Methods for estimating demography and detecting between-locus differences in the effective population size and mutation rate

It is known that the effective population size (Ne) and the mutation rate (u) vary across the genome. Here we show that ignoring this heterogeneity may lead to biased estimates of past demography. To solve the problem, we develop new methods for jointly inferring past changes in population size and detecting variation in Ne and u between loci. These methods rely on either polymorphism data alone or both polymorphism and divergence data. In addition to inferring demography, we can use the methods to study a variety of questions: (1) comparing sex chromosomes to autosomes (for finding evidence for male-driven evolution, an unequal sex ratio, or sex-biased demographic changes); (2) analysing multi-locus data from within autosomes or sex chromosomes (for studying determinants of variability in Ne and u). Simulations suggest that the methods can provide accurate parameter estimates and have substantial statistical power for detecting difference in Ne and u. As an example, we use the methods to analyse a polymorphism dataset from Drosophila simulans. We find clear evidence for rapid population expansion. The results also indicate that the autosomes have a higher mutation rate than the X chromosome, and that the sex ratio is probably female-biased. The new methods have been implemented in a user-friendly package

Determinants of the efficacy of natural selection on coding and noncoding variability in two passerine species

Population genetic theory predicts that selection should be more effective when the effective population size (Ne) is larger, and that the efficacy of selection should correlate positively with recombination rate. Here, we analyzed the genomes of ten great tits and ten zebra finches. Nucleotide diversity at 4-fold degenerate sites indicates that zebra finches have a 2.83-fold larger Ne. We obtained clear evidence that purifying selection is more effective in zebra finches. The proportion of substitutions at 0-fold degenerate sites fixed by positive selection (α) is high in both species (great tit 48%; zebra finch 64%) and is significantly higher in zebra finches. When α was estimated on GC-conservative changes (i.e., between A and T and between G and C), the estimates reduced in both species (great tit 22%; zebra finch 53%). A theoretical model presented herein suggests that failing to control for the effects of GC-biased gene conversion (gBGC) is potentially a contributor to the overestimation of α, and that this effect cannot be alleviated by first fitting a demographic model to neutral variants. We present the first estimates in birds for α in the untranslated regions, and found evidence for substantial adaptive changes. Finally, although purifying selection is stronger in high-recombination regions, we obtained mixed evidence for α increasing with recombination rate, especially after accounting for gBGC. These results highlight that it is important to consider the potential confounding effects of gBGC when quantifying selection and that our understanding of what determines the efficacy of selection is incomplete

A review of the distribution of particulate trace elements in urban terrestrial environments and its application to considerations of risk

We review the evolution, state of the art and future lines of research on the sources, transport pathways, and sinks of particulate trace elements in urban terrestrial environments to include the atmosphere, soils, and street and indoor dusts. Such studies reveal reductions in the emissions of some elements of historical concern such as Pb, with interest consequently focusing on other toxic trace elements such as As, Cd, Hg, Zn, and Cu. While establishment of levels of these elements is important in assessing the potential impacts of human society on the urban environment, it is also necessary to apply this knowledge in conjunction with information on the toxicity of those trace elements and the degree of exposure of human receptors to an assessment of whether such contamination represents a real risk to the city’s inhabitants and therefore how this risk can be addressed

Mutations in the histone methyltransferase gene KMT2B cause complex early-onset dystonia.

Histone lysine methylation, mediated by mixed-lineage leukemia (MLL) proteins, is now known to be critical in the regulation of gene expression, genomic stability, cell cycle and nuclear architecture. Despite MLL proteins being postulated as essential for normal development, little is known about the specific functions of the different MLL lysine methyltransferases. Here we report heterozygous variants in the gene KMT2B (also known as MLL4) in 27 unrelated individuals with a complex progressive childhood-onset dystonia, often associated with a typical facial appearance and characteristic brain magnetic resonance imaging findings. Over time, the majority of affected individuals developed prominent cervical, cranial and laryngeal dystonia. Marked clinical benefit, including the restoration of independent ambulation in some cases, was observed following deep brain stimulation (DBS). These findings highlight a clinically recognizable and potentially treatable form of genetic dystonia, demonstrating the crucial role of KMT2B in the physiological control of voluntary movement.Funding for the project was provided by the Wellcome Trust for UK10K (WT091310) and DDD Study. The DDD study presents independent research commissioned by the Health Innovation Challenge Fund [grant number HICF-1009-003] - see www.ddduk.org/access.html for full acknowledgement. This work was supported in part by the Intramural Research Program of the National Human Genome Research Institute and the Common Fund, NIH Office of the Director. This work was supported in part by the German Ministry of Research and Education (grant nos. 01GS08160 and 01GS08167; German Mental Retardation Network) as part of the National Genome Research Network to A.R. and D.W. and by the Deutsche Forschungsgemeinschaft (AB393/2-2) to A.R. Brain expression data was provided by the UK Human Brain Expression Consortium (UKBEC), which comprises John A. Hardy, Mina Ryten, Michael Weale, Daniah Trabzuni, Adaikalavan Ramasamy, Colin Smith and Robert Walker, affiliated with UCL Institute of Neurology (J.H., M.R., D.T.), King’s College London (M.R., M.W., A.R.) and the University of Edinburgh (C.S., R.W.)

Factors and processes shaping the population structure and distribution of genetic variation across the species range of the freshwater snail radix balthica (Pulmonata, Basommatophora)

Background: Factors and processes shaping the population structure and spatial distribution of genetic diversity across a species' distribution range are important in determining the range limits. We comprehensively analysed the influence of recurrent and historic factors and processes on the population genetic structure, mating system and the distribution of genetic variability of the pulmonate freshwater snail Radix balthica. This analysis was based on microsatellite variation and mitochondrial haplotypes using Generalised Linear Statistical Modelling in a Model Selection framework. Results: Populations of R. balthica were found throughout North-Western Europe with range margins marked either by dispersal barriers or the presence of other Radix taxa. Overall, the population structure was characterised by distance independent passive dispersal mainly along a Southwest-Northeast axis, the absence of isolation-by-distance together with rather isolated and genetically depauperated populations compared to the variation present in the entire species due to strong local drift. A recent, climate driven range expansion explained most of the variance in genetic variation, reducing at least temporarily the genetic variability in this area. Other factors such as geographic marginality and dispersal barriers play only a minor role. Conclusions: To our knowledge, such a population structure has rarely been reported before. It might nevertheless be typical for passively dispersed, patchily distributed taxa (e.g. freshwater invertebrates). The strong local drift implied in such a structure is expected to erode genetic variation at both neutral and coding loci and thus probably diminish evolutionary potential. This study shows that the analysis of multiple factors is crucial for the inference of the processes shaping the distribution of genetic variation throughout species ranges. Additional files Additional file 1: Distribution of Radix taxa. Spatial distribution of the Radix MOTU as defined in Pfenninger et al. 2006 plus an additional, newly discovered taxon. This map is the basis for the inference of the species range of R. balthica. Additional file 2: Sampling site table and spatial distribution of diversity indices, selfing estimates and inferred population bottlenecks for R. balthica. Table of sampling site code, geographical position in decimal degrees latitude and longitude, number of individuals analysed with microsatellites (Nnuc), expected heterozygosity (HE) and standard deviation across loci, mean rarefied number of alleles per microsatellite locus (A) and their standard deviation, number of individuals analysed for mitochondrial variation (Nmt), rarefied number of mitochondrial COI haplotypes (Hmt), number of individuals measured for body size (Nsize). Figures A1 - A3 show a graphical representation of the spatial distribution of He, Hmt and, s, respectively. Additional file 3: Assessment of environmental marginality. PCA (principle component analysis) on 35 climatic parameters for the period from 1960 - 2000 from publicly availableWorldClim data. Additional file 4: Inference of a recent climate driven range expansion in R. balthica. Analysis of the freshwater benthos long term monitoring data of the Swedish national monitoring databases at the Swedish University of Agricultural Sciences SLU with canonical correspondence analysis

Differing patterns of selection and geospatial genetic diversity within two leading Plasmodium vivax candidate vaccine antigens

Although Plasmodium vivax is a leading cause of malaria around the world, only a handful of vivax antigens are being studied for vaccine development. Here, we investigated genetic signatures of selection and geospatial genetic diversity of two leading vivax vaccine antigens--Plasmodium vivax merozoite surface protein 1 (pvmsp-1) and Plasmodium vivax circumsporozoite protein (pvcsp). Using scalable next-generation sequencing, we deep-sequenced amplicons of the 42 kDa region of pvmsp-1 (n = 44) and the complete gene of pvcsp (n = 47) from Cambodian isolates. These sequences were then compared with global parasite populations obtained from GenBank. Using a combination of statistical and phylogenetic methods to assess for selection and population structure, we found strong evidence of balancing selection in the 42 kDa region of pvmsp-1, which varied significantly over the length of the gene, consistent with immune-mediated selection. In pvcsp, the highly variable central repeat region also showed patterns consistent with immune selection, which were lacking outside the repeat. The patterns of selection seen in both genes differed from their P. falciparum orthologs. In addition, we found that, similar to merozoite antigens from P. falciparum malaria, genetic diversity of pvmsp-1 sequences showed no geographic clustering, while the non-merozoite antigen, pvcsp, showed strong geographic clustering. These findings suggest that while immune selection may act on both vivax vaccine candidate antigens, the geographic distribution of genetic variability differs greatly between these two genes. The selective forces driving this diversification could lead to antigen escape and vaccine failure. Better understanding the geographic distribution of genetic variability in vaccine candidate antigens will be key to designing and implementing efficacious vaccines

Whole-genome sequencing reveals host factors underlying critical COVID-19

Critical COVID-19 is caused by immune-mediated inflammatory lung injury. Host genetic variation influences the development of illness requiring critical care1 or hospitalization2–4 after infection with SARS-CoV-2. The GenOMICC (Genetics of Mortality in Critical Care) study enables the comparison of genomes from individuals who are critically ill with those of population controls to find underlying disease mechanisms. Here we use whole-genome sequencing in 7,491 critically ill individuals compared with 48,400 controls to discover and replicate 23 independent variants that significantly predispose to critical COVID-19. We identify 16 new independent associations, including variants within genes that are involved in interferon signalling (IL10RB and PLSCR1), leucocyte differentiation (BCL11A) and blood-type antigen secretor status (FUT2). Using transcriptome-wide association and colocalization to infer the effect of gene expression on disease severity, we find evidence that implicates multiple genes—including reduced expression of a membrane flippase (ATP11A), and increased expression of a mucin (MUC1)—in critical disease. Mendelian randomization provides evidence in support of causal roles for myeloid cell adhesion molecules (SELE, ICAM5 and CD209) and the coagulation factor F8, all of which are potentially druggable targets. Our results are broadly consistent with a multi-component model of COVID-19 pathophysiology, in which at least two distinct mechanisms can predispose to life-threatening disease: failure to control viral replication; or an enhanced tendency towards pulmonary inflammation and intravascular coagulation. We show that comparison between cases of critical illness and population controls is highly efficient for the detection of therapeutically relevant mechanisms of disease

X chromosomal regulation in flies: when less is more

In Drosophila, dosage compensation of the single male X chromosome involves upregulation of expression of X linked genes. Dosage compensation complex or the male specific lethal (MSL) complex is intimately involved in this regulation. The MSL complex members decorate the male X chromosome by binding on hundreds of sites along the X chromosome. Recent genome wide analysis has brought new light into X chromosomal regulation. It is becoming increasingly clear that although the X chromosome achieves male specific regulation via the MSL complex members, a number of general factors also impinge on this regulation. Future studies integrating these aspects promise to shed more light into this epigenetic phenomenon